Updates to work with Chainer 5.1.0 and Python 3 #18

sometimescasey · 2018-12-17T19:35:58Z

The following changes allowed me to run gconv_experiments using:

chainer (5.1.0)
cupy-cuda90 (5.1.0)
Python 3.6.7

Addresses many of the issues mentioned in #13 .

Feel free to close PR if you don't want to merge, but I thought I'd put this here for others who might find it useful. Thanks!

…tions for space groups to test_garray.py and test_gfunc.py

3D GrouPy

Ning0Luo · 2019-04-12T19:38:28Z

Hi, I use python Python 2.7.15 and I change the code according to this. But one error is thrown out as the following:
AttributeError: 'module' object has no attribute 'Reshape
Is there any way to solve that?

sometimescasey · 2019-04-12T20:30:20Z

@Ning0Luo unfortunately all my changes above were tested against Python 3.6.7, and I'm not sure what specific versions of the necessary packages you're using. I suspect you just need to upgrade a package. Do you have the full stacktrace, so we can see what specific line threw that error?

Ning0Luo · 2019-04-12T21:43:24Z

Hi, the full stack trace is the following:
groupy.garray.test_garray.test_p4_array ... ok groupy.garray.test_garray.test_p4m_array ... ok groupy.garray.test_garray.test_z2_array ... ok groupy.garray.test_garray.test_z3_array ... ok groupy.garray.test_garray.test_c4_array ... ok groupy.garray.test_garray.test_d4_array ... ok groupy.garray.test_garray.test_o_array ... ok groupy.garray.test_garray.test_c4h_array ... ok groupy.garray.test_garray.test_c4ht_array ... ok groupy.garray.test_garray.test_d4h_array ... ok groupy.garray.test_garray.test_d4ht_array ... ok groupy.garray.test_garray.test_oh_array ... ok groupy.garray.test_garray.test_ot_array ... ok groupy.garray.test_garray.test_oht_array ... ok groupy.gconv.chainer_gconv.kernels.test_integer_indexing_cuda_kernel.test_index_group_func ... ok groupy.gconv.chainer_gconv.test_gconv.test_p4_net_equivariance ... /home/ning_luo/GrouPy/groupy/gfunc/gfuncarray.py:78: FutureWarning: Using a non-tuple sequence for multidimensional indexing is deprecated; use arr[tuple(seq)]instead ofarr[seq]. In the future this will be interpreted as an array index, arr[np.array(seq)], which will result either in an error or a different result. vi = self.v[inds] ERROR groupy.gconv.chainer_gconv.test_gconv.test_p4m_net_equivariance ... ERROR groupy.gconv.chainer_gconv.test_gconv.test_g_z2_conv_equivariance ... ERROR groupy.gconv.chainer_gconv.test_gconv.test_p4_p4_conv_equivariance ... ERROR groupy.gconv.chainer_gconv.test_gconv.test_p4m_p4m_conv_equivariance ... ERROR groupy.gconv.chainer_gconv.test_transform_filter.test_transform_grad ... ERROR groupy.gfunc.test_gfuncarray.test_ot_func ... /home/ning_luo/GrouPy/groupy/garray/garray.py:144: FutureWarning: Using a non-tuple sequence for multidimensional indexing is deprecated; use arr[tuple(seq)]instead ofarr[seq]. In the future this will be interpreted as an array index, arr[np.array(seq)]`, which will result either in an error or a different result.
return self.factory(data=self.data[key], p=self.p)
ok
groupy.gfunc.test_gfuncarray.test_oht_func ... ok
groupy.gfunc.test_gfuncarray.test_c4ht_func ... ok
groupy.gfunc.test_gfuncarray.test_d4ht_func ... ok
groupy.gfunc.test_gfuncarray.test_p4_func ... ok
groupy.gfunc.test_gfuncarray.test_p4m_func ... ok
groupy.gfunc.test_gfuncarray.test_z2_func ... ok
groupy.gfunc.test_gfuncarray.test_z3_func ... ok

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4_net_equivariance

Traceback (most recent call last):
File "/home/ning_luo/.local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 19, in test_p4_net_equivariance
point_group=c4a,
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 112, in check_equivariance
fmap = layer(fmap)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/splitgconv2d.py", line 155, in call
tw = F.Reshape(tw_shape)(tw)
AttributeError: 'module' object has no attribute 'Reshape'

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4m_net_equivariance

Traceback (most recent call last):
File "/home/ning_luo/.local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 37, in test_p4m_net_equivariance
point_group=d4a,
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 112, in check_equivariance
fmap = layer(fmap)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/splitgconv2d.py", line 155, in call
tw = F.Reshape(tw_shape)(tw)
AttributeError: 'module' object has no attribute 'Reshape'

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_g_z2_conv_equivariance

Traceback (most recent call last):
File "/home/ning_luo/.local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 54, in test_g_z2_conv_equivariance
point_group=c4a,
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 112, in check_equivariance
fmap = layer(fmap)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/splitgconv2d.py", line 155, in call
tw = F.Reshape(tw_shape)(tw)
AttributeError: 'module' object has no attribute 'Reshape'

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4_p4_conv_equivariance

Traceback (most recent call last):
File "/home/ning_luo/.local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 77, in test_p4_p4_conv_equivariance
point_group=c4a,
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 112, in check_equivariance
fmap = layer(fmap)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/splitgconv2d.py", line 155, in call
tw = F.Reshape(tw_shape)(tw)
AttributeError: 'module' object has no attribute 'Reshape'

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4m_p4m_conv_equivariance

Traceback (most recent call last):
File "/home/ning_luo/.local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 92, in test_p4m_p4m_conv_equivariance
point_group=d4a,
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_gconv.py", line 112, in check_equivariance
fmap = layer(fmap)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/splitgconv2d.py", line 155, in call
tw = F.Reshape(tw_shape)(tw)
AttributeError: 'module' object has no attribute 'Reshape'

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_transform_filter.test_transform_grad

Traceback (most recent call last):
File "/home/ning_luo/.local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_transform_filter.py", line 16, in test_transform_grad
check_transform_c4_z2_grad(dtype, toll)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_transform_filter.py", line 25, in check_transform_c4_z2_grad
check_transform_grad(inds, w, TransformGFilter, dtype, toll)
File "/home/ning_luo/GrouPy/groupy/gconv/chainer_gconv/test_transform_filter.py", line 47, in check_transform_grad
from chainer import gradient_check
File "/home/ning_luo/.local/lib/python2.7/site-packages/chainer/gradient_check.py", line 11, in
from chainer import testing
File "/home/ning_luo/.local/lib/python2.7/site-packages/chainer/testing/init.py", line 4, in
from chainer.testing.distribution_test import distribution_unittest # NOQA
File "/home/ning_luo/.local/lib/python2.7/site-packages/chainer/testing/distribution_test.py", line 24, in
class distribution_unittest(unittest.TestCase):
File "/home/ning_luo/.local/lib/python2.7/site-packages/chainer/testing/distribution_test.py", line 78, in distribution_unittest
@skip_not_in_test_target('batch_shape')
File "/home/ning_luo/.local/lib/python2.7/site-packages/chainer/testing/attr.py", line 73, in gpu
return multi_gpu(1)(f)
File "/home/ning_luo/.local/lib/python2.7/site-packages/chainer/testing/attr.py", line 55, in multi_gpu
check_available()
File "/home/ning_luo/.local/lib/python2.7/site-packages/chainer/testing/attr.py", line 21, in check_available
Reason: {}: {}'''.format(name, type(_error).name, _error))
RuntimeError: chainer.testing.attr is not available.

Reason: ImportError: No module named pytest

Ran 29 tests in 28.538s

FAILED (errors=6)`

Marysia Winkels and others added 10 commits April 6, 2018 17:05

Added GArray and GFunc for groups C4h, D4h, O and Oh. Added test func…

1b56055

…tions for space groups to test_garray.py and test_gfunc.py

Add 3D GConv implementation for tensorflow

67c6869

Update comments

a227150

Remove flake8 warnings and imports to init files.

35206e8

Merge pull request tscohen#10 from marysia/3d-conv

9668591

3D GrouPy

Update setup.py to include kernels and pooling

b80ef31

change oshape and ostrides from int* to ptrdiff_t*

8bf53a9

changes to make this work in Python 3

2a04cfa

python3: xrange is range

8fcb7e0

update plane_group_spatial_max_pooling.py for chainer 5.1.0

b72da12

sometimescasey mentioned this pull request Dec 17, 2018

Updates for chainer 5.1.0, ProgressBar 2.5 tscohen/gconv_experiments#2

Open

tscohen force-pushed the master branch from 9668591 to c6f40f2 Compare April 18, 2019 09:26

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Updates to work with Chainer 5.1.0 and Python 3 #18

Updates to work with Chainer 5.1.0 and Python 3 #18

sometimescasey commented Dec 17, 2018

Ning0Luo commented Apr 12, 2019

sometimescasey commented Apr 12, 2019

Ning0Luo commented Apr 12, 2019

Updates to work with Chainer 5.1.0 and Python 3 #18

Are you sure you want to change the base?

Updates to work with Chainer 5.1.0 and Python 3 #18

Conversation

sometimescasey commented Dec 17, 2018

Ning0Luo commented Apr 12, 2019

sometimescasey commented Apr 12, 2019

Ning0Luo commented Apr 12, 2019

====================================================================== ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4_net_equivariance

====================================================================== ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4m_net_equivariance

====================================================================== ERROR: groupy.gconv.chainer_gconv.test_gconv.test_g_z2_conv_equivariance

====================================================================== ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4_p4_conv_equivariance

====================================================================== ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4m_p4m_conv_equivariance

====================================================================== ERROR: groupy.gconv.chainer_gconv.test_transform_filter.test_transform_grad

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4_net_equivariance

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4m_net_equivariance

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_g_z2_conv_equivariance

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4_p4_conv_equivariance

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_gconv.test_p4m_p4m_conv_equivariance

======================================================================
ERROR: groupy.gconv.chainer_gconv.test_transform_filter.test_transform_grad